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(54) A dynamic distributed muticasl routirig p 

(57) The distribution of multicast information in a 

communicaJ ions network formed from a p!u raiity of com- 
muniicatiorts nodes, e.g.. .ATM switches, is enhanced by 


mtocof 

providing an afficsent mechanism for routing a request 
to jOin a multicast conriectfon toan originator of the mul- 
ticast and an efticient mechanism for then connecting 
the reauest©!' to the multicast connection. 




RELD OF THE j^lV£^aTSOM: 



The iRverjtion relates to data networks and more * 
particuiariy fsiatea to a muiticast protocol for iocating, 
jotning and teaving a multicast group that is receiving 
particular information. 

BACKGROUND O?" TH£ im miiOH: so 



Presently: a ossr associated with a rnultirnGdia ter- 
minal, e, g , a conventionai wori«station or PC, may enter 
a request via the ten-ninal to participate in a particular 
event, e.g. , a lecture, audio/video confer encs, teievised >s 
spsecfi, etc., ti'sat is being provided by a node, e.g., a 
packet svyitch, in a digitai network. The event is typically 
associated with some type oS identifier, i.e., group iden- 
tifier (e.g., 800 number or conference bridging number 
in convsntional telephone networks) so thai a user who 
wants to participate in the event may identify the event 
in a request that the user stibmits lo his/her terminal 
The user's terminal then foi-wards the reques! to an as- 
sociated serving nods within the digital network. A group 
identifier may represent a caiiection of users who are 
iiitsi^ested in pailicuiar iniormation associated wish Ihe 
event. {Note that group identifier i-s different from an 
identifier that is used lo identify a particular user.) Typi- 
cally, the rnembership associated with a group identifier 
may be dynamic such that a member may join and leave so 
the group at any time. Also, there is no restriction on the 
physical location of multicast group members who may 
or may not be at the same physical location. The net- 
work maintains information relating to the group and typ- 
ically does this by constructing a network directory 3S 
which fs used to traci<, the connectivity ol active mem- 
bers. That iS. a serving node submits tihe group identifier 
to the network directory The directory, in turn, returns 
the address of the nearest node wfiich it can join, The 
sei-y'ing node then sends a request to join the multicast 40 
group to the identitted nods. A node that josns or isaves 
a multicast group must notify the directory so that it can 
update the membership information. Unfortunately, 
membership may change so trsquentfy that manage- 
ment of such a directory may become costly and ineffi- 
cient. 

The network may also maintain such membership 
by constructir^g a multicast server in the network. Data 
that is sen! by a user is then first delivered to the server, 
which, in turns, delivers the information to ai! other mem- s-o 
bers In the multicast group. Although this approach ap- 
pears to be simple so implement it, nevertheless, may 
lead to a single point of failure in Ihs eventthat the server 
fails. Moreover, this approach does not use the network 
resources efficiently, since user data has to be sent to s$ 
the server 



The foregoing ss addressed and the relevant ars is 
advanced by providing an efficient and scaieabie mech- 
amsrn for a data network So maintain multicast group in- 
formation m a distributed fashion in which any node tn 
the network may automallcaliy locate, join and leave a 
multicast group. The mechanism is distnbisted so that a 
Single node has to maintain complete information about 
ttie other participants of the multicast group. In pai'ttcu- 
lar, in accordance with an illuslrattve embodiiTsent of The 
invention, a network node enters a .■'equest to pin a mul- 
ticast group, by constriictinq at least one routing tree 
formed f rom selected paths to each of a number of other 
nodes identified in the tree and sending a tind message 
identifying the multicast gioup to the selected nodes in 
accordance with -he routing tree. In response to receipt 
of 8 iTtessage identifying the nearest node connected to 
the muiticast group, the requesting node then simply 
sends a join rnsssage to the identified node to loin the 
multicast group. 

These and other aspects of the claimed invention 
are disclosed in the ensuring detailed description, ac- 
companying drawings and claims. 

BRIEF DSSCBIPriC^i OF THE DRAWiNGS: 



in the drawing: 

FiG. ! shows a oommunicatioris network in whicn 
the principles of the invention may be practiced: 

FiG. 2 iliustrates a routing tree rooted at a particular 
one of the nodes of FIG. f : 

FIG. 3 shows a state diagram illustrating the oper- 
ation ot a nods m accordance with the principles of 
the invention: 

FIGs. 4-9 are respective expanded versions of the 
operations states shown in FIG. 3, and 

FIGs, 1 0-1 5 illustrate the operation of the principles 
of the irwention in an Illustrative hierarchical net- 
work. 

DETASLEO OESCHIPTIDN: 

Our inventfva protocol supports what we call a "Par- 
ticipant-initiated Join", in which a node initiates a re- 
quest to pin a mufticast group and. in doing so, deter- 
mines the networK path that is to be used to join the muS- 
ticast. The protcxoi f)as two phases. We call the first 
phase the "Find" phase, since it is the requesting node 
that determines the identity of the nodes that are already 
or, the multicast tree. We cai! the second phase the 
"Join" phase, since the requesting node attempts to pin 
the nearesT node that is already on the multicast tree, in 



tne rind phase, a node that wants to join the mijitjcast 
group originates a REQUEST message and sends it to 
ali of its neighbors on the shostesi patti tree rcsoted at 
the rsqiiesting node. A neighbor that fecesves the mes- 
sage then forwards it downstream to its neighbors along 
the iinks of the shortest path tree rooted at the origsnat- 
ing node. This prcxess continues umil the REQUEST 
message reaches either a node that is already on the 
muiticast tree or a leaf node of the shortest path tree 
rooted al the originating nods {i.e. . the node that has the 
soughl-after rrfUlsicast information.) Each node that is al- 
ready on the muiticast tree replies to the request, with 
the cost parameter set to 0. The ieaf nodes that are not 
on the multicast tree reply to she request with the cost 
parameter set to -1 . On receiving ali of she replies to the 
message, a node dsiarmines the nears.st node and for- 
wards the REPLY message irom the nearest node up- 
stream towards the originator of the REQUEST Before 
doing so, the node updates the cost function to reflect 
the coai from this node to the nearest node. The origi- 
nator receives a!i the replies and determines the nearest 
node. This ends the Find phase. In ihe Join phase, the 
requesting nods determines the path to the nearest 
node and sends a JOI N-REQ message. The determined 
path is inserted in the message so that an intermediate 
node does not have to make the same determination. 
The nearest nods (having the stjught-after inEormation) 
replies with a JOi,N-ACK message and ail the nodes in 
the path become a branch of the multicast tree 

An iiiustrative example of the foregoing is shown m 
FIG 1 . tn Vi/hich sought-after muiticast information is as- 
sumed to be a multimedia event 150,. e.g., a televised 
tGciure. yoilimedia signals characterizing the multime- 
dia event are supplied to node 105, which may operate 
as a conventional video server for the purpose of sup- 
plying the video signal in the form of digital signals to a 
user who has entered a request to receive a copy of 
such signals via networi<, 100 formed from data nodes 
105, 110, 115. 120, 125, 130 and 135. In an iiiustrative 
embodiment of the invention, each of the nodes may be, 
for example, a conventional .ATM switch. AsstJme ihat a 
user associated with workstation 1 70 in a conventiona! 
manner enters a requssl via a iteyboard (not shown) to 
view the event on monitor 175, in which the request in- 
cludes an identifier associated with the rnuitimedia 
event. The request, however, does not contain the iden- 
tity (e.g., address) of the source of the multicast infar- 
mation. Workstation 170, in response to rscsipt of the 
request, converts the request into a form eKpected by 
associated network node 125. also shown as the E 
nods. As an aspect of the invention, network 100 does 
not include a directory identifying the informiation that is 
respectively supplied by the network 100 nodes. Ac- 
cordirjgSy. !o locate the nods that has the muliicast in- 
formation, node 125 wii! poi! each of the other network 
100 nodes. Before doing so, however, nods 125 con- 
structs a tree formed from selected paths to each of the 
other nodes, in which the selection is based on prede- 



termined parameter, for example, cost, number of hops, 
etc. In an illustrative embodiment of the invention, cost 
is characterised by a weight value. Such weight values 
are shown in parentheses in FIG. 1 and are used, as 

■5 mentioned, to identify a least cost path/routs. For exam- 
ple, if node t20 (D) needs to send a message to node 
105 (A), then node 120 will likely send the message via 
node 110 (8) since the sum of the weights associated 
with the links in that path is lass than the sum of the 

10 weights associated with the links in the via nc>ds 1 1 5 (C) 
path, i.e., (.5) -^ H) < (6) + (3). 

Thus, in accordance with known techniques, node 
1 25, in the "find" phase, constructs a path tree and uses 
that tree to cont.roi the routing of a message to locate a 

IS r5od;e that has the requested muiticast information, i.e., 
the televised event ISO. .An example of such a tree is 
illustrated in F!G. 2. Node 1 20 thus sends a "Find" mes- 
sage to node 1 35 (G) and to node i20(D) in accord with 
the tree. The "Find" message includes, inter aiia, thead- 

30 dress of the message originator, identifier associated 
with the sought-after information, a request for the iden- 
tity of the nods that has the sought-after information. 
The message may also include inforrnalion characterij- 
ing the constructed path tree. Accordingly, then, upon 

SB receipt of the message, node 1 35 retisrns a Reply mies- 
sage with the cost parameter set So - t. Although node 
1 20 does not have the sought-after information, it does 
not discard the message since the path t.ree indicates 
that the message should be individually routed to nodes 

30 110, 115 and 130, as s.hown in FIG 2. Simiiarfy, when 
the message reaches node 110, the node does not dis- 
card the message {even though it does not have the 
sought-after information), but forwards it to node 105 
(A). Since, it is assumed that node 105 has the sought 

3S after information, then it responds to the received mes- 
sage by .'eturning to node 125 a reply message contain - 
ing the identity (address) of node 105 and with the cost 
parameter sel to 0, 

Upon receipt of the latter message, node 1 25 enters 

40 the "Join" phase, as discus-sed above, in this phase, 
node 125 constructs the shortest path to node 105 and 
sends a Join message containing the node i 25 address 
with a request to join the multicast of the identified event. 
Referring to FIG 2, it is seen that such p.ath would 

•^5 be via nodes 110 a.nd 120. rather than via nodes 115 
and 1,20. Nods 105 returns a Join-ACK and then starts 
supplying the televised ave.nt to node 125 via the deter- 
mined path. When nodes 110 and 120. which are in the 
path of the muiticast, start receiving the multicast mfor- 

so mation then they note in their respective interna! mem- 
ories that they also have such information. 

Assume at this point that a user associated with 
node 1 30 also wishes to receive the muiticast and enters 
a request tor that information. Similarly, nocJs 130 con- 

ss striicts a leasi-cast path tree and launches its own find 
message in accordance with the tree (not shown). When 
the message reaches node 1 20, it responds with a reply 
message to notie 1 30 indicating that it has the informa- 



lion. As discussed above, node 1 30 accumulates the re- 
ply messages and then determines irofj^ those message 
which of ihe nodes naving the sought-after information 
is closest to node 130. in the present illustrative exam- 
pis, the ciosest node for the desired purpose would be 
node 120, Accordingly, then node 130 may join the mo!- 
ticast by sending a Josn message to node 120, rather 
than to node 1 05, Thus, when node 1 20 recesvesa pack- 
et ot such information from node 110, it sends a copy to 
node 1 25 and a copy to node 1 30. 

If at M& point, the user at workstation 1 70 enters a 
request totemiinate receipt of the miiltioasi, then node 
1 25 forms a "Leave" message and sends the n^essage 
to node 120 in accordance with the constructed path 
tree rooted at node 125. When node 120 receives the 
message, it stores the message in ioca! memory and 
terminates the -supplying ot the multicast information to 
node 1 25 but wiii continue supplying that infonmaiion as 
it is received to node 13Ci. 11 priof to the end of the tele- 
vised event, node 130 launches a "Leave" message, 
then node 120, in response to that message and in re- 
sponse to having no other receiver for the rriulticast, 
sends a message to nods 1 1 0 !o terminate the supplying 
of the rnolticas! to node 1 20, Similarly, node 1 1 0 sends 
a similar me-ssage to node 1 05 if it has no other receiver 
for the multicast information, 

A Situation could arise in which a node receives, at 
about tne same time (concurrently), Find messages 
from a plurality of nodes, e,g , two nodes To handle this 
situation and preserve the correctness of !h© distributed 
pfotocoi, a node, e.g., node 125, appends a time stamp 
to a Find message, in this way, if a node, e.g.. node D, 
receives concurrently "Find" message from nodes 126 
and 1 30, then it processes the Find me-ssage bearing: 
the earliest time stamp and returns a Reply message to 
the node, e.g,, node 130. that launched the Find mes- 
sage bearing the tatest time stamp. Then, when the least 
cost multicast path is established from node 1 05 to node 
1 20, then node 1 30 launches a Find message atter w,raii- 
fng a random (or a predetermined) period of time and 
then proceeds as discussed above. 

In an illustrative ernbodinr^ent of the invention, the 
principles of the invention are embodied in a state ma- 
chine which is implemented in each network nod© for 
each multicasf group. An ilius!.rative example of such a 
state machine is illustrated in FIG. 3 and is composed 
of five major states, namely IDLE 301 . W;AIT 302, TEN- 
TATIVE 303, ACTIVE 304 and RETRY 305. Before dis- 
cussing FiG. 3, It would be best to review the different 
m8ssag8(s) that may be sent by a node attempting to 
join a multicast and the messagets) that are sent by the 
other nodes in the networtt in response to a request to 
join a multicaai session. Srsefly, a node that wants to join 
a multicast tree/session sends a REQUEST message, 
in the manner discu-ssed above. The header of the re- 
quest message contains, inter aiia, the iden^i^/ of the 
muiticass information, sender 10, and time-stamp, (it 
may also contain a retry count.) A request message can 



only be originated by a node that is in the iDLfvi state, A 
node sends a REPLY message in response to receipt 
of a REQUEST message, A\ REPLY message includes 
the header information of the REQUEST miessage and 

S an associated cost parameter which identifies the cost 
Of the shortest path from the current nod>3 to the nearest 
node that is already on the tree. The cost is updated as 
the REPLY moves from one node to another node. The 
cost is set to -1 if there Is no .ACTIVE node on that par- 
se ticulaf path. A node sends a RETRY message if it de- 
termines that another request is already being proc- 
essed, as discussed above. The request with the eariier 
time-stamp is allowed to continue while a RETRY mes- 
sage is sent to the originator of the request having the 

'S later time stafnp, as mentioned above. A node sends a 
JOIN-REQ message when it wants to lain the multicast 
session/tree. The path to the neasest node is encoded 
within this message. An ACTIVE node sends a JOhNi- 
AC;< message in response to receiving a JOIN-REQ 

so rnessage. The receipt of this message indicates that a 
node is on the muiticast tree, A node sends a LEAVE to 
an ACTIVE neighbor node when it wants to teave tne 
multicast session./tre8. 

Turning then to FiG, 3, Briefly, in the IDLE state a 

2S node has no information pertaining to the multicast in- 
formation (or tree). A node enters the WAIT state after 
it has sent/forwarded a f-^EQiJEST rnessage and is wail- 
ing for a response A node enters the TENTATiVE state 
after it has sent/forwarded a JOIN-REQ message io- 

30 wards the nearest node that is already on the multicast 
tree. In this state, the node is waiting for a JQIf^-ACK 
message. A nods enters the .ACTIVE state when it joins 
a multicast session {i.e., it <s on the multicast tree. A 
node reaches this state when it receives a JOi:\f-ACK 

ss message from a node that is already on the tree. A node 
in the ACTIVE state may also maintain the tree-based 
informiation regarding all the links that are incident on it 
and belong to the tree, Howevei', the node does not 
maintain any state information about new requests to 

'*o ioin the tree A node reaches the RETRY state when it 
iS the originator of a REQUEST to join a multicast tree 
and receives a RETRY message via one of the links of 
the tree. In this state, a node does not have to maintain 
any state information relating to other requests. Also, 
the node waits for a random period of time before re- 
sending the original REQUEST If may also tracts the 
number of REQUEST messages that it sends. 

An expanded version of the IDLE stats is shown in 
FIG, 4, As mentioned above a node initiates a RE- 

so QUEST message when tt is in the IDLE state, 

A nrxie in this state only can initiate a REGLsEST 
miessage, .A REQUEST message is ideniified using the 
tuple <senderlD,time-stamp,retry-count>, where send- 
erlD is the ID of the node that is the originator of the 

ss message, tlnne-stamp is the value ol a counter at the 
sendsrID and retry-count is the number of attemipts the 
nods nas made to join the tree. The fstry-<:oun! is initially 
0. The initial REQUEST message is forwarded on all the 



links via the shortsst-path tree rooJsct at the originating 
node. The node then enters the WAiT state. Tm follow- 
ing actions are taken whsn ihe node mcsives either a 
F^EQUEST message (action path 401) )or JOiM REQ 
message (action patti 402). Fof exampis. assume that 
a REQUEST massage is received from node B, and 
tiieretore contains the tupie <SDB,CNTRg, RCg>. Then 
tiie receiving node takes the foilowing actions: 

if the message i-s not on the shortest path, then send 
a REPLY With cost = -1 towards the originator. Eise, 
update the time stamp (locai counter). 

Save the state information of the message. 

Forward the REQUEST message. Change State = 
WAiT 

If no available iinl<, send RSPLY with cost = ■ 1 . State 
- iDLE, 

If a JOIN-REQ message Is received from node 8, 
then the receiving node proceeds as toiiows: 



its Isnlts, than the node tal<es the following actions {path 
S02): 

ignore the REPLY message if it does not contain 
5 state information. 

If not the tast reply, then stoi^e the cost iniorn'sation 
and wait tor other repiy messages. 

io If the last REPLY, then determine best message fay 
minirni2inQ ihe (cost fteid o! message + link cost). 
Then forward the best message towards ihe origi- 
nator of the REQUEST after updating cost. Change 
state := IDLE. 

?s 

!f originator of REQUEST message, then compute 
the shortest path to the nearest node. Send JOIN- 
REQ message towards that node via the shortest 
path- Change state TENTATiVE. 

so 

it the node receives a RETRY msss<3.ge vta one of 
its iinks, then Ihe node takes the following actions (path 
601 , FIG. 6): 

Ignore the RETRY message if it does not contain 
state informasion. 



Forward JOi N-REQ message to ne>:t node. Changs ss 
State = TENTATIVE. 



If current nods Is the final destination noted in the 
message, then return a RETRY message to the 
originator {Note that this condition may arise if the 
node changes its stats from ACTIVE to IDLE duri.ng 
ihe time between the sending of the REQUEST 
message and JOIN-REQ message to node B.) 

An expanded version of the W.A!T state is shown In 
FIGs. 5A, SB and 6. For FlGs. 5A and B , assume that 
a node received a REQUEST message containing the 
tupie <iD^,CWTR,i^,RC;,,> from node A. 

If the node also receives a REQUEST message 
from node B, <IDg,CNTRg,RCg>. Then the nods takes 
the foiiowing actions (path 501 ); 

Update the local time stamp counter. 

if Ihe message had not been received via the short- 
est path, then send a REPLY lo B, setting cost io -1 . 

If the message is received via the shortes! pslh and 
A precedes B in time, then send a RETRY message 
to B. 

If the message is received via the shortest path and 
B precedes A in time, then send a RETRY message 
to A. Clear state information pertaining to A. Save 
information pertaining to B and torsvard FIEQUEST 
message. 

if the node receives a REPLY message via one of 



Clear the state information and forward the RETRY 
message towards the originator of REQUEST. 

Ciiange state :-- IDLE. 

if originator of f-'-^EQUEST, then change state = RE- 

try" 

35 Increment retry count 

Wart for a random period of time, then resend the 
REQUEST message with She updated retry count 
value, (Note: The same counter value (CNTR) wiii 
40 be used to ensure fairness,} 

If the node receives a JOIN-REQ message from a 
node, e.g,, node B, then the riode proceeds as follows 
(path 602, FIG, 6): 

46 

Change state TEf^lTATIVE, 

if next node information is available, then forward 
the JOIN-REQ message to the next node and send 
so a RETRY message to node A, 

If no nexi: node, then send a f"^eTRY message to- 
wards the originator ot the JOIN-REQ message, 

ss An feKpanded version of the TENTATIVE state of 
FIG 3, is snoxw! in FIG, 7, sn which a node enters the 
TENTATIVE State alter it receives a JOiN-REO mes- 
sage originated t>y anoiher node. e,g,, node A. if at that 



so 



time, the nods receri/es a REQUEST message from 
node B containing ti^3 tup?s <IDg,CNTRB, RCb>, then 
the rsoeiviog node proceeds in she foltowing manner 
(path 701): 

If a F-^£QUEST message is not received via the 
shortest patri, then return a REPLy with cost = -t to 
ihe ongsnator Else, 

Update locai counter value. 

Send RETRY message towards the originator of the 
message. 

II, on ti^e other hand, the ncide f€;csives a RETRY 
Message, then the nods takes the foilowing actions 
(path 702): 

If RETRY matches JOiN-REO, forward RETRY 
message back towards node A. 

Change state = IDLE. 

ignore it RETRY message does not match JOiN- 
REQ. 

If the node otherwise receives a JOiN-ACK Mm- 
saga, then the node lakes the foliowing ac.?ion.s (path 
703): 

Change State = ACTIVE. 
Forward Join-.Ack to node A. 
Clear a!i state information. 

Update multicast Sree Inforrnallon to include ihe link 
over which the JOIN-REQ was received. 

An expanded version of the ACTIVE stats of FIG, 
3., is shown in FIG. 8, in which a node is already on the 
multicast tree. In that case, the node only responds to 
new requests and join requests. Other messages may 
be ignored. 

If a node in the active stats receives a REQUEST 
message from node 8 containing the tuple <IDs,C!^J~ 
TRg, RCg>, then Ihe recsivirig node tai<:8S the following 
action (path 801): 

If the REQUEST message is not received via the 
shortest path, then send REPLY message with cost 
= -1 Id the originator. Else. 

Update local counter Value. 

Send a REPLY VJith cost = 0. 

if, on the other hand, the nods receives a JOIN- 



REQ message from node 8. then the node returns a 
JOIN-ACK message to B (path 802), If the node other- 
wise receives a LEAVE message from node B, then the 
node takes the following actions: 

5 

Update multicast tree information. 

It only one ACTNE neighbor and the node is not 
member of multicast group, then send LEAVE mes- 
'0 sage to neighbor 

Change state ~ IDLE, 

,An expanded version of the RETRY State is shown 
^s in F!Q. 9, A node enters the RETRY state after sending 
a REQUEST message. Assume that node A is in the 
retry state and the associated tuple information is -- 
<IDa,CNTR;^.RC,<-^>, and that node A receives a RE- 
QUEST message from node 8 whose tuple information 
so is <iDg,CNTRg,RCB>. For that case, rsods A takes the 
fQiiowing actions (path 901): 

if message Is not on the shortest path, send a RE- 
PLY back with cost set to -1. Update local counter, 

ss 

If A precedes B in lime, then send a RETRY mes- 
sage towards node B. 

If B precedes A in time, then save S's stale infor- 
30 mation and forward the REQUEST message. Save 
A's information and stop A's retf^,' timer (.A cannot 
join the multicast group until S has joined). 

Change state WAIT. (A is now waiting for B) 

35 

if, on the other hand., a JOIN-REQ message is re- 
ceived from node B, then the node la!<.es the foilowing 
actions (path 902): 

. Change state = TENTATIVE. Forward JOiN-REQ 
message to next node on the path. 

Save A's information and wait. (A cannot resend 
f-HEQtJEST message until S has Joined multicast 
■is group). 

II Retry timer has expired, then increment Relr>' 
count and send REQUEST message containing the 
following tuple: 

so <\Df^.CMJR^.Rei>. The old vaius of CIMTRa is 
used to ensure fairness. 

The foregoing may be readily implemented in a net- 
work formed from a pftjraiity of ao-calied Peer groups. 
ss in which a peer group is a group of network nodes form- 
ing a smaller .network, in particular, a large r^etwork 
formed from a large number of nodes may be iogicaily 
restructured to improve the efficiency of the number. 



Such reslrticturing snlaiis forming nodes into groups 
each operating as a smallar nstworic, in which connec- 
tion management funcSsons are logically extended to 
each Isvsl of the network hierarchy. The state informa- 
tion is maintained at each physical node. !n ao'dition, 
each group is represented as a logical nods at a highar 
levef of the network hierarchy fay a peer group leader 
(PGL), The PQL maintains separate state information 
for ihat logica! nods at that hierarchical level The logical 
nodes perform the sam^e state transit lans as the physical 
nodes at the lowest level o! fhe network hierarchy. In 
that sense, our inventive protocol may be applied to 
such a furtwork with the following modsficafions (exten- 
sions). 



i) A Joining Node prompts {requests} its PGL to en- 
ter the "Find" phase at the next higher ievei of the 
hierarchy. At the logical level, pre-estabhshsd virtu- 
al connections between iogical nodes are used to 
send the REQUEST and REPLY messages. During 
the "Find" phase, the logical nodes may make a 
transition from the IDLE state -o the WAIT state and 
RETRY state similar to the physical nodes. 

ii) It the PGL is already active at the higher ievei 
(which may mean that some other ACT! VE node ex- 
fsis in the peer-group), tlien this information is re- 
turned to the requesting node. On receipt of the In- 
fofmation. the requesting node executes the proto- 
col to determine the nearest ACTIVE node within 
the peer-group. The ID of the nearesi ACTiVE node 
{physical or logical) is returned to the iower level re- 
questing node if thecurreni level is the lowest ievel. 
then the requesting node enters the "Join" phase. 

ill} Otherwise, the PGL recursively executes the 
above steps at higher levels until it reaches the top 
level of the hierarchy At that level, the PGL enters 
the "Find" phase. At the end of the "Find" phase, 
the requesting node has the ID of the nearest AC- 
TIVE node. (Note that this ID may either be the 
physical ID ot the node within the same peer-group 
(single peer group case) or the logical ID of a higher 
level nods in a logical peer-group (multiple peer 
group case). 

Jam Phm& 



Based on the available topoiogicas iniormation. a re- 
questing node determines the path to the nearest node. 
Th© path may not be complete if the nearest node is a 
logscal node in a higher level, sogical peer-group. The 
defermmed path is stored in the forrrs ot a Designated 
Transtt List (DTl), as discussed in the Private fsiatvvork- 
Network interface (PNNI) specification version TO. 
available from tfie AT?^ Forum, 2570 West El Camino 



Real, Suite 304, Mountain View, Calitomia 94040-1313, 
which is hereby incorpofated by reference. The DTL is 
embedded in the JO!N~REQ message before it is for- 
warded to the nearest node. On receiving: a JOiN-REQ 
■5 message, a node executes the following protocol: 

1) If the node is already ACTIVE, it returns a JOIN- 
ACK message. The JOm- ACK is returned along 
the same path (in the reverse direction) to originat- 
f5 ing node. 

ii) Else^ if the DTL stack is not empty, then the 
JOIN-REQ message is forwarded to the next 
node based on the information available in the 

t5 DTL. (fsiots that new paths may be added to the 

DTL by ingress nodes, as e:J<pl8ined in the 
above-mentioned refsrence. Also note that the 
JOIN-REQ and JOIN-ACK messages miay be 
serrt on network signaling channel. When the 

so JOIN-REQ or JOIN-ACK messages are sent 

acioss border links, the logical node at the ap- 
propriate level has to be informed so thai the 
logical node can rnalie a state transition to the 
TENTATIVE or ACTIVE state respectively This 
IS done by sending a copy of the JOIN-REQ or 
JOiN-AGK message to the appropriate logica! 
node, 

ill) If the DTL stack is emipty then the node en- 
ters the "Find" phase to determine the nearesi 
30 ACTIVE node. The nearest node infonmafion is 

then encoded as DTL and the message is far- 
warded to the nearest node. 

Similar actions are taken when a participating node 
35 leaves the multicast group. In this case a LEAA/E mes- 
sage is sent to an ACTiVE neighbor node, provided that 
the participant has only one .ACTIVE neighbor. The par- 
ticipant node then enters the IDLE state. The neighbor 
node may then fon^/ard the LE.AVE message to its near- 
40 est neighbor if it is not a paiUcipant and has oniy one 
ACTIVE neighbor VVhen a LEAVE message is sent 
across a border link, then a copy of the message is sent 
to the appropriate logical node, so that the global state 
of the node can be changed to the IDLE state. 

The extended protocoi described immediately 
above may be further appreciated when discussed in 
conjunction with the examples illustrated in FIGs. iO 
through 13, in which each FIG. iliustrafss a network 
formed from three peer groups of network nodes (e.g., 
AT:M switches) 20t, 20,2 and 203. The nodes in peer 
group (a) 201 are re-spsctively designated .A.I through 
A.5, {b} 202 are respectively designated B.1 through B 
5 and (c) 203 are respectively designated C.1 ttuough 
C-6. The dark (or filled in) node seives as the PQL for 
ss the respective peer group in each of FIGs. 10 through 
t3. Assume for FIG, 10 that node A.3 wants to join a 
muUicast group, and, therefore sends a request to that 
effect to its PGL (node A), which causes that PGL to 



enter the "Find" phase ai the higher levsi as noted by 
the eilipse containing iogica! PGLs A. 8 and C. Since 
PGL A enters the highest levei, it sends a REQUEST 
message to the other members of its pesr-group to de- 
Sermins who has the requested multicast information. 
Assiime that PGL A determines that there are no rr^em- 
bers of the multicast in peer-groups 8 ar^d C. This infor- 
mation is passed on to node A. 3 arsd the state of nods 

A. 3 becomes ACTIVE. The multicast tree now consists 
of a single node A.3. Globally, the state n^iachine for log- 
ical nods A also makes a transition to the ACTIVE state. 
The ACTIVE nodes at each level are shown as boxes 
in FIG, 11- The participant nodes at each isvsj are 
shown as lightly shaded boxes. 

Assume that rsods C.4 now wants to join the multi- 
cast group, and, therefore sends a request to its PGL 
(node C) to enter the "Find" phase. Node C, in response 
thereto, sends a REQUEST message to logical node B 
and logical node A. (Note that node C may enter the 
RETRY slate if there is a concurrent .Join request from 
iogicai nods B.) I? there are no other requests, then only 
togical node A is ACTIVE and this information is sent to 
node C.4 by logical node C, This action completes the 
"Find" phase for node C.4. 

In the "Join" phase, node C.4 encodes a path to 
peer-group A as a DTL and forwards a JOI N-REQ mes- 
sage to peer-group .A. The message enters peer-group 

B, across the border link (C.2-B.4}. Here, node B:4 is 
the ingress node and the DTL slack is not empty (step 
(ii) of the "Join" phase). I^ods B.4 identifies a path 
through its peer-group to peer-group A and appends the 
path to the DTL, It then foavards the message towards 
peer-group A. i^Jode 8 4 also sends a copy o1 ths JOiN- 
REQ message to the f-'^GL node B.I, which maintains 
the global state machine for logical node B Node B 1 
updates the global state machine of node B to TENTA- 
TIVE slate. Assume that the message enters peer- 
group A across finS^ (B.5-A.5). The DTL stack is now 
empty (step (iii) of the "Join" phase). Node A,5 upon re- 
ceipt of the message enters the 'Find" phase to deter- 
mine the nearest node that shotiid receive the message, 
i.e., node A.3. It then appends the path to nods A.3 to 
the DTL and fonvards the JOI N-REQ to node .A.3, t^ode 
A.3, being in the ACTIVE state, replies to receipt of the 
message by returning a JOIN-ACK message (step (i) of 
the "Join" phase). The JOIN-ACK messages retraces 
the p.sfh fallowed by the JOIN-REQ message. When she 
JOIN-ACK crosses the border itr-.k (A.S-B.S), the state 
n-iachirje of logical nods B is updated to the ACTIVE 
state. Logical nods G becomes .ACTIVE when the JOIN- 
ACK me.ssage is sent across link (B.4--C.2). The rssuit- 
ing muiticast tree is shown as dotted lines in FIG. la. 
Node B.2 can now join the multicast tree by joining node 
8.4, as shown in FIG, 13. 

If participant A,3 leaves the multicast group, then it 
sends a LEAVE message lo node A. S, which propagates 
the message to node B.S. Node .A.5 aiso sends a copy 
of the LE.AVE message to node A 1 , so that the global 



stats machine of togical peer-group A may be changed 
to the IDLE state. Node 8.5 aiso sends a LEAVE mes- 
sage to node B.4. However, the propagation of the latter 
message stops at node B.4 since that node has two AC- 

5 TIVE neighbors, nodes B.1 and C.2. The resulting tree 
is shown in FIG. 14, Assume now node B.2 similarly 
leaves the multicast group, in this instant the LEAVE 
message propagates to node C.4. Recall that when the 
LEAVE message is sent across link B.4-C.2, a copy ss 

JO also sent to nods S, 1 so tfial the global state machine 
for the peer-group may be changed to IDLE state. The 
final tree consisting of only nodeC.4 isshown in FIG. 16. 



rs Claims 

1 . A method ot josnsng a rnusticasl connection originat- 
ing from a source node distributing multicast intor- 
matson. said muittcast connection being established 

20 in a network composed cjf a plurality of communica- 
tions nodes, saia method comprising tna steps of 

ai one of said nodes, responsive to receipt of a 
requ8.st so reeeix'e -said multicast information. 

25 constructing at Iscist one routing tree formed 

from selected paths to each of a nui-nber of oth- 
er nodes identified in the tree and sending a 
message ideniifyng said inforn^ation to the se- 
lected nodes in accordance with ths routing 

30 tree, and 

at said one node, responsive to receipt of a 
message identifying aaio source node as being 
the onginatof of the iden?ified information. 
3S sending a message containing a request to join 

multicast distribution of the identified informa- 
tion. 

2. The method of ciaim 1 further comprising the steps 
40 of 

at the source node, responsive to receipt of a 
message containing a request to join the multicast 
distribution of the identified inforrr^ation, retijrntng 
an acknowledgment message to the Qriginator of 
'fs the message. 

3. Tns method of claim 1 fijrther compnsing the steps 
of 

so at the source node, responsive to receipt of a 

message containing a request to join the mul- 
ticast distribution of the identified intormation. 
constructing a network path tree rrxjted at the 
source node and ejttending to the nods origi- 
nating the message, and 

supplying the multicast information via the path 
tree rooted at the source node. 



4, The method of clam 3 wherein said multicast Srse 
sncJudss at ons intermediate node between the 
soL'rce node and the node originating the message 
and iA.^-i8fein said method further comprises the 
steps O! 5 

at the intermediate node, responsive to receiv- 
ing from anotlier one said nodes a message 
conEainsng a request tor said muiticast informa- 
tson, resuming to said other ons of said nodes 10 
a reply message Indicating that sasd trslermedi- 
ate node can supply said muKicast information, 
and 

at said ottier one of sasd nodes accymulating 
ail reply messages to its request for the multi- 
cast information and determining which of 
nodes returning a reply message is closest to 
said other ons of said nodes, and 

eo 

sending a r^riessage to join the muiticast to the 
determined closest one of the nodes that re- 
turned a repiy message to said other one of said 
nodes, 

s$ 

5. The method of clasm 4 further comprising the step of 

at the ciosesi one of tne nodes, responsive to 
recotpt of the join message and thereafter respon- 
sive to receipt of multicast information via ^hs path 
tree rooted at the source node, sending a copy of so 
the received muttioast information to the other one 
of said nodes, 

S, The method of claim 5 wherein said intefmediate 
node !s said closest one ot fhs nodes and wherein 3S 
said meihod further comprises the steps of 

at said intermediate node, responsive to re- 
ceiving from said one node a message addressed 
to said source node and requesting a termination of 
the sending of the mu iticasf information to said one 40 
rxi-xie. terminating the sending of the muiticast infor- 
maiion to said one node and continuing to supply 
the multicast information as it ss recesvedto said oth- 
er one of sasd nodes. 

46 

7. The method of ciairn 5 wherein said snleiTnediate 
node IS said closest one of the nodes and wherein 
said method further comprises Ihe steps of 

at the intermediate node, responsive to re- 
ceiving from said other one of said nodes a mss- 
sage addressed So said source nods and requesting 
a iermination of the -sending of the muiticast infor- 
mation to sasd other one of -sasd nodes, tsi-m!nating 
the sending of the multicast information to said oth- 
er one of said nodes, and responsive to having no ss 
oiher recipient for said mufttCinst information, send- 
ing She i-eceived termination message so the source 
node. 



a A method of joii-iing a multicast connection originat- 
ing from a source node distnbiJting multicast snfor- 
i^natson, said multicast connection being established 
in a nstwo!-f< comsjosed of a plorafity of corsrimunica- 
tions nodes, said method compnsing the steps of 

at a networf? node, f ssponsive to recerving from 
first and second oiher ones of the network 
node.':; respective message requests to ioin the 
muiticast, determining as a function of a prede- 
termined parameter, which one of the firsS and 
second nodes !s to tae connected first to the 
multicast coinnection and sending a wait mes- 
sage to the other one of the first and second 
nodes, 

forwarding the message received from said one 
of said first and second nodes over a path con- 
tained in that message, and 

thereafter, responsive to receipt of mutticast in- 
formation from a source via a path rooted at the 
source, supplying the multicast information to 
said one of said first and second nodes 

9. The method of claim 6 further comprising the steps 
of 

at said othei- one of said firs! and second nodes, 
response to receipt of the wait message, wait- 
ing a predetermined period of time, and 

at the expiration of !hat peood of tirrie. again 
sending a message requesSing receipt of the 
muiticast informatfon. 

1 0. The method of claim 9 further comprising she step of 

at said network node, responsive to receipt of 
the request imessage from said other one of said 
first and second nodes, supplying said muiticast in- 
formation to said other one ot said first and second 
nodes as if ss i-eceived from the source. 

11 . The rneshod of claim 9 further compnsing the steps 
of 

at said networi? node, responsive to receiving 
from said one nods of said first and second imodes 
a message addressed to said source node and re- 
questing a termiination of the sending of the muiti- 
cast information to said one of said first and second 
nodes, tei-minating the sending of the multicast in- 
fO!"matfon to that node and continsjing to supply the 
miiiticast information as it is received to said other 
one of said first and second nodes 

12. The method of claim 9 fuslher comprising the steps 
of 

at said network nods, responsive to receiving 



from said other one of said first and second nodes 
a message addressed to sad source node and re- 
questing a tsrrs-sination of the sending of tfje mylU- 
cast information to said other one of said first and 
second nodes, terminating the sending ol the mul - 
ticast information to said that node, and rsisponsive 
to having no other recipien! for said multicast infor- 
rnation, sending the received message requesting 
termination to the source node. 




mmisi Cm sim) 



If CMIPx > CUTRa, SO 

CNis - mm ft 



I 







mil mK 1 

WITH COST ^ 







JES/ifioil IS i£«r\ 



ilQlCS! oil M UNIS 
OF THE SFT, £KC£?! THI 



IF nm mm 
mmn. M DTI 







%m inmmmn in 

msmi imiL 
mmhm the mn-m 

TO m[ NEll NODr, 



("teni^tate") 



FIG. SA 



Sim A mim 
Bkm mmm t 



^5 



S cum - cif ] 



MBSIGC TAili HAS « 



IF mih > SET 

cms s CHTfe f I 



MO 







k mm mm 
mm COST s ~ K 





IF MODI A IS LEAF 

j®£ or ^ 







T0W.4gOS Y. 






FIG, SB 



(WMT 


SWE) 











IF mm mmt mi 



m 



(MM) 



mimm mbt woe 

lASffi on 8£SI COST. 







FOU « mm FROM 
MIST M TOWARDS 
lOf, ATO UFOAimC cost. 


< 






mm 1 imm m 
msmi imii 






mmw mm 
TO mmisi mdi 



< f SM CMTR > 0 



TOWIiDS NMEST 



FIG. 8 



IF CMTfe > cmm, 



mn cm ^ o 



We sill 



mm? 





TES 














TO «HiOi N00L 



FIG. 9 



REQUEST 



IF CMlh > CNTfe, 



JOIN"® 







<iF mm < umi4y 




m 


/ wmmki% \ 

\IEIF OF SP%)/ 






umm m m. mm 
OF THE spT, mm 
mi mmtm am 




IF NEXT mm 
mma m on 



TES 




%m mmmmu m 

IHC JOl-EQ TO THE 
M£IT NO0£. 






(TENT, S14TE) 



am Y mim m 

yiSSM TABLE. 



CmW) 



(19) 



J): 



(11) 



.EP0 854 618 A3 



(12) EUROPEAM PATENT AFFLiCATIOf^ 

(88) Date of pubfcatloo A3: (51 ) i,,t C!7: H04L 1 H04L 1 2/1 8 



(43) Date of pubSication .A2: 



(21) 
{22} Date of fi 



(84) 



AT BE CH DE DK ES R SB OR §E LS LU MQ 



AL LT L¥ MK RO SI 
(30) PrloriEy; 17.01.1097 US 



(71 ) Applicant LOCEHT TECHNOLOQISS im.. 

f 07974~0§3S (OS) 



(72) inventors: 



07724 (US) 




(54) A 
(57) The 



of 

fOf 

8,g , ATM 



sx>y^sn9 protocol 

irjformatfon in a providisig an efficient mechanism for roufing a request 
a plurality of com- to join a muiticasf connection to art originator of the muh 
is enhanced by ticast and an efficient mechanism for tlien connecting 
the requester to the multicast conf^ection. 





EP 9S 30 0053 



CiSation of doeuiTieni wi* iRtJicafion, whws appropriate. 
Qj reievafii. passages 



RING S E ET AL: "NUITKAST ROUTIK IN 



ACM IMM&kCTlOm OH COMPUTER 

SYSTEM. US, ASSOCIATION FOR COMPUTING 

MACHIiyfRY. NEW Yomi, 

vol. S, no. 2, 1 Hay 1990 (1990-Q5-QI), 

pages 85-110, XPQ0Qi37193 

ISSn-. 0734-2071 



4.4 * 



JA n ET AL: "WLTICAST NETWORK 
CO^l^SECTION ARCHITECTURS" 
I3H SYSTEs^S <30yR!^Al,yS,I8M CORP. ARMK. 

NEW 'iom, 

VCsl . 34. no, 4, 

2.1 SepteffiSser 1995 (1995-09-21) , pages 
590-60,2. XP00Q542401 
rS,f.H: 001S~367C 

* page 592, left-hartil CQlmn, Hoe 4S - 
page 596, right-hand column, line 7 * 



SLTICAST GROUP 

IN HIGH SPEED WIDE 



ARLINGTON, TEXAS, MAY 20 - 24, 1991. LOS 
ALAHITOS. IEEE CORP. SOC, PRESS, US. 
vol. COW. 11, 20 ?*?3y 199! { 1591-05-20) . 
sjages 231-238, m 
ISSN; 0-8186-2144-3 
* Section 4: Set 



1 he prsaem ssarch reoort ms &©en drawn up fas all cisims 



GArEGORV OF CiTED DOCWSiiaffS 

A : fiaiticufartv :sievar<! ii Imsn atws 

■f ■ p&RKuism: reiayssm li oorrtijineo wsm at5«f>8r 



9 J!jU' 2001 



1-3 



HQ4L 12/56 
H0^L12/1S 




EP 98 30 0053 



ApstSScatiof) fjutafesr 



CLAIMS ^r^CURB^^^^G FEES 



t^^8 preseni guropesn patef5» appSscaJjofi comprised at the tirne of filing mor® Shan fen ciaiffis. 

□ Oniy pari o? the ci9ifns have Sseen paicf wiJhiR She pfgScribsd time Simit. The presssis European sasrcin 
report has besn dfavvn up for tfse Sirs? tes-! ciaifvss and ios iixfse ciaitas tor which ciaims fees have 
baen paid, nameiy ciaim{s): 



□ Ho ciaifTis Sees fiave tjeen paki wstSiir! ihe prsscriijed tirrse iimii The present fcuros^sart searc!^ report Sias 
beers drawn up for Ste StsJ !»fs csasms, 



LM^K OF UNITY OF MVEI^TiQS^ 



Tte SearcSn Division considefB tha! tiie present European paters apptatiof! does r»t corsspiy wttii she 
feqyirementg of ur^ny of invenfiofs and ssSates to severaS im'sritsorss or groups of ii-svsfffioiis, oameiy: 



see sheet 8 



-■i E;«eri Brum] w I'or sai tiams 



"I I ^ i! r^^-^bs, l-^i "fcCir IS ir-T>''v i hoiiJ "^i n >> * " <si, ^rrr^ i ) <? o •>"3r i i son 
-J rSid r«j! mvm savrjiens ot a«y aaa«(onai !«e. 



~ I Orslv osr! oS me {imner sfisrch sees have been pasa wiShio rixad ams iinist, s no pisassw!! fcurooears 
ifwerajoris in '^soeot o? wrsch sftarcJi tees have Beer^ ama. namelv aasfrss: 



□ None Of ft^e Suitfser search fses fjavs Ssssn paid vuttriir? Jte imsd ims Umil The present g«r«)j)eah s&srch 
report has besr^ drawn up tor tfsosss parts of fhe Europesn pstervt appScatiOfs wNdi nstels i»'ihe sfivsntton 
first maritksTSjJ ifi She oSsisss, nam«iy cS^f^^s: 




The Search DiviSion conssQSi'stfKittr^e presera Eufopean pasentappiieaiion does nat corss&iy vnitsi me 

I. Claims: I-? 

Plsthod for joining a multicast cannsctlors. Receiving b. 
'-i'qusii io i-S£.vr i vt= :;fu:L!CiiSt i n^oriss 1 1 Of! . CofistructiriQ ? 

accordance with the rout-ing trse 



Hetliod of joining a iKulticast consectKin.. Receiving a join 
^:e$sags from a -Mrit s^cof^d node. D?p>>nd1i-sQ on « 
predstsriJiin^d parsrnster cor^siectlng cm node s?id ssn-iipg a 
w,)''t K!P5i:ag^ to th« second node. 



